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We discuss temperature chaos in mean field and realistic 3D spin glasses. Our numerical simu- 
lations show no trace of a temperature chaotic behavior for the system sizes considered. We discuss 
the experimental and theoretical implications of these findings. 
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The problem of chaos in spin glasses has been un- 
der investigations for many years IQ-H]. Even in the 
Sherrington-Kirkpatrick (SK) model, which is well under- 
stood with Parisi solution of the mean field theory [^ , 
the possible presence or absence of temperature chaos 
is still an open problem. On the contrary, for exam- 
ple, chaos induced by a magnetic field h was already dis- 
cussed by Parisi 15 years ago ||l|], and it is a clear feature 
of the Replica Symmetry Breaking (RSB) scenario. We 
will give here numerical evidences of the fact that, for all 
lattice sizes we are able to investigate by using state of 
the art optimized Monte Carlo method |ll|, there is no 
trace of temperature chaos in mean field (infinite range) 
and realistic spin glasses, in contradiction with previous 
claims [|U^-y. The question about temperature chaos 
can be phrased by considering a typical equilibrium con- 
figuration at temperature T, and one (under the same 
realization of the quenched disorder) at T' = T + dT, 
where dT is small: how similar are such two configu- 
rations? In a chaos scenario for any non-zero dT the 
typical overlap would be exponentially small in the sys- 
tem size. We study both SK and Diluted Mean Field 
(DMF) (l|] models. We consider the DMF model in its 
version with constant connectivity c = 6. Each lattice 
site is connected to c other sites chosen at random. It 
is interesting to check if this model has the same fea- 
tures as the SK model. We also study the 3D Edwards 
Anderson (EA) realistic spin glass. In all models spin 
variables are Ising like {a — ±1), and the couplings J 
can take the two values ±1 with probability i. Our 
Monte Carlo dynamics is based on Parallel Tempering 
(PT) nw : we run in parallel two sets of copies of the sys- 
tem, and always take overlap of configurations from two 
different Markov chains. We use all standard precautions 
for checking thcrmalization of our data pi| . The indica- 
tor of a potential chaotic behavior will be the two tem- 
perature overlap q^p, j^ — 
usual square overlap g^y is a special case oi g^-/ j. . 



0.45 



{{iEl^^PrP) )■ T^ 



q2(0.4,T)N=512 

q2(T,T)N=512 

q2(0.4,T) N=4096 

q2(T,T) N=4096 

q2 perturbation theory 




0.8 0.9 1 1.1 1.2 1.3 

T 

'^^ at equal and different T values for the SK 



FIG. 1. q 
model, with N = 512 and iV = 4096 sites 
is the perturbative result for equal T q^^' 
details. 
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Let us start from the analysis of our data for the SK 
model. In figure m we plot the square overlap for the two 
temperature values (0.4, T) (i.e. the overlap of a copy 
of the system at temperature T' = 0.4 with a copy of 
the system at T g (0.4, 1.35)), and the one at equal tem- 
perature {T,T). The two upper (on the left side of the 
plot) dashed curves (merging at T = 0.4 at a value close 
to 0.42) arc for N = 512 spins (a small lattice size), the 
upper one being the (0.4, T) curve and the lower one the 
(T, T) one. The two lower curves (merging at T = 0.4 at 
a value close to 0.40) are for N — 4096 (our largest lattice 
for the SK model): of these two lower curves the solid, 
upper curve is for (0.4, T), while the dashed lower one is 
the (r,T) (7(2) _ The fifth curve from the top, that stops 
down at T = 0.7 is the perturbative result for g^ Ip |1^ ] 
(useful for checking our numerics and the quality of the 
approach to the asymptotic large volume limit). Here we 
only plot data from two lattice sizes, and do not show the 
statistical errors that are small enough not to affect any 
of the issue discussed here, but would make the picture 



less readable. We show data for the lowest temperature 
we have been able to thermalize, T' = 0.4. The same 
qualitative picture holds for larger T' values (T' < Tc). 

One notices at first glance from figure|l]that for both N 
values (and, as we will see, for all N values and different 
systems we have analyzed) Qq j ^ > qrplp- (T > 0.4). 
This is what happens in a non-chaotic systems (for exam- 
ple ferromagnets where q^rH^'^ = M{TYM{T'f, where 
M{T) is the magnetization at temperature T), and is 
very different from what would happen in a system with 
T-chaotic states. The second crucial observation is that 
the distance between q^^rj. and g^^ , at fixed T > 
0.4, decreases with N, the two curves even seem to col- 
lapse at large N. This kind of behavior shows the absence 
of temperature chaos in the Sherrington-Kirkpatrick sys- 
tem and, as we will discuss in the following, in the diluted 
mean field and 31? EA spin glasses. This evidence, to- 
gether with an understanding of the physical mechanism 
that is at the origin of this behavior (thanks to the anal- 
ysis of P{q)) is the main point of this note. 
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FIG. 2. q^o^lf:^^ - qr^r'^^ as a function of T for the SK 
model with different A'^ values. 

A more quantitative evidence comes from figure 0, 
where we plot q^ ^^ qxT as a function of T for 

the SK model with N = 256, 512, 1024, 2048 and 4096. 
Here the errors are computed by an analysis of sample to 
sample fluctuations (it is important not to forget that the 
points for different temperatures are strongly correlated, 
since they involve the same T — 0.4 data, or data from 
different temperatures but nevertheless from the same 
PT simulation). In the large volume limit both contribu- 
tions to the difference are zero for T > Tc = 1, so that the 
non zero value of the curves in this regime gives us a mea- 
sure of finite size effects. Large lattices have larger fluc- 
tuations. This is connected to the non-self- averageness 
of P.j{q)- the peaks of Pj{q) become narrower for large 
lattices (eventually approaching ^-functions in the large 
volume limit), and averaging them to compute expecta- 



tion values of the overlap gives a wiggling behavior, that 
becomes smooth only for a very large number of disorder 
samples. We are not able to keep under control a precise 
fit of the data of figure g for iV -^ cx), but the strong 
decrease of the difference of the data at large A^ is clear, 
and the possibility that the limit is zero everywhere looks 
very plausible (it would be very interesting to understand 
theoretically this behavior). 
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FIG. 3. Pjiq) for the same selected disorder realization at 
three different temperatures of the SK model with A'^ = 4096 
sites. 

We use figure for trying to understand better the 
mechanism governing how stable states of the system 
vary as a function of T. We plot the probability dis- 
tribution Pj{q) for a given disorder realization of the SK 
model with A^ = 4096. We show, from top to bottom, 
the resuhs at T = 0.50, 0.45 and 0.40. The function 
Pj{q) should be symmetric around q — Q, since we are 
at zero magnetic field. The level of symmetry reached 
by our finite statistics sample is a measure of the quality 
of our thcrmalization: from figure ^ it looks very good. 
Note that there is no peak close to, or at, the origin: this 
disorder realization carries little weight in the q ~ re- 
gion. At the lowest T value there are 5 peaks for positive 
q, three of which very well separated. It is interesting 
to follow the evolution of Pj{q) from T — 0.50 down to 
T = 0.40. At T = 0.50 there are basically two very broad 
peaks, that get resolved at T = 0.45: one broad peak 
gets divided in two clear peaks (that become very clear 
aX T — 0.4), while the other forms a 3 peak structure, 
that get different weights at T = 0.4. What one sees in 
figure ra is interesting since it constitutes a typical pat- 
tern: when lowering T, states start to contribute to the 
Pj{q) by bifurcations (new peaks emerge) and by smooth 
rearrangements of the weights. One never sees dramatic 
changes involving strong redistributions of weight among 
far away peaks, that would be typical of a chaotic situ- 
ation: the phase space is obviously very complex, as it 
has to be in a situation characterized by RSB pOl, but 



the T-dependence of the phase space is smooth and non 
chaotic. 
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FIG. 4. As in figure |, but DMF, N = 64, 512 and 4096. 

The situation in the DMF model (where T^ ~ 2.07) 
is very similar to the one in the SK model. In figure 
we show the analogous of figure 0, for A^ = 64, 512 and 
4096 spins. The two figures are very similar, and even 
the size of the difference we are plotting is very similar in 
the two models, when comparing the same values of N. 
The situation in the DMF model looks exactly the same 
of the SK model: there is no temperature chaos. 
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5. q^ ' at equal and different T values for the 3D EA 



The situation in the 3D EA model is different only in 
that finite size effects are very large (this is well known 
from numerical simulations jlj] ) . In figure |^ we show q^^^^ 
at equal and different T values for L = 4, 8 and 16. It 
is clear that g(2)'(^) decreases noticeably with N — L^ 
for all values of T. It is also remarkable that even at 
very large T values (with T far larger than the estimated 
value of Tc ~ 1.16 ^^) g(2),(Ar) jg different from zero 
even at TV = 4096 = 1(?\ Apart of that figure shows a 



situation very similar to the one of |l|. We are definitively 
not in a situation where ^q i t goes to zero exponen- 
tially and q^ j}' goes to a non zero limit (even if the 
distance between the two curves for L = 16 has become 
very small, and even negative in a temperature region). 
In figure g we show the iD analogous of figures g and 
0. Again, even for T > Tc, on the smaller lattices one 
has non-zero differences: finite size effects are large, but 
apart from that the emerging picture is analogous to the 
one we have found in mean field (diluted and not). 

Now, before discussing the data, we give a few details 
about our runs. For the SK model we use Tmm = 0.4 = 
OATc. We simulate N = 256, 512, 1024, 2048 and 4096: 
for the different TV cases we have from 26 to 142 sam- 
ples, a set of from 38 to 75 temperature values with a dT 
going from 0.025 to 0.0125. We run 200000 sweeps but 
for the N = 4096 and N = 2048 lattices where we run 
400000 sweeps (we always use for measurement only the 
second part of the run). For the DMF model we have 
Trmn = 0.8 ~ 0.4Tc. We use from 640 to 1024 samples 
for N — 64, 512 and 4096. Here T^ax is 3, the number 
of temperatures from 45 to 89 and the number of itera- 
tions from 100000 to 200000. In the 3D EA model we use 
Trmn = 0.4, Tmax = 2.075 (here T, ~ 1.16) and a dT go- 
ing from 0.050 to 0.025. We have 1344 samples for L = 4 
(200000 sweeps) and L = 8 (300000 sweeps), and 64 sam- 
ples for 16^^ (where Tmm = 0.5, with 3450000 sweeps, this 
is very many sweeps of many tempering copies) . Our SK 
program was multi-spin coded on different sites of the 
same system (we store 64 spins of the system in the same 
word), while the DMF and 3D codes are multi-spin coded 
on different copies of the system [O] . We want to note 
that, as compared to previous numerical simulations, we 
have been able (thanks to a large computational effort 
and to the use of PT) to thermalize the systems at very 
low T values. It is also interesting to notice that in the 
N — 4096 case the 3D EA model requires many more 
sweeps than the DMF and the SK model. 

In all our simulations we do not observe any tempera- 
ture chaos effect. This is true for the SK model, the di- 
luted mean field and the 3D EA model: the three models 
behave very similarly. The differences we have plotted, 
that would decrease exponentially in a chaotic scenario, 
do not decrease faster than logarithmically. Obviously 
from our numerical findings we cannot be sure that things 
will not change for very large system sizes, but again, we 
can claim that the absence of any temperature chaotic 
behavior is crystal clear on our lattice size. Two final 
comments are in order. At first, as we already said, we 
cannot be sure about the behavior in the very large sys- 
tem limit: the difference of Qrp, j, and g^ ^ (for T' ~ 0.4rc 
and T > T') decreases with the system volume, and is 
close to zero on the larger lattice sizes we can simulate. 
This difference could eventually become negative, and the 
correlation at T ^ T' could eventually drop exponentially 



on very large lattices: we can only say we do not see any 
trace of that. The second comment is that, in any case, 
our results have an experimental relevance: the number 
of spins that are equilibrated during a real experiment 
is of an order of magnitude only slightly larger than the 
order of magnitude of the one we can thermalize in our 
numerical simulations p8| , so our results strongly suggest 
the absence of temperature chaos in real experiments. 
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FIG. 6. Qo^lf/^ - Qt^t'^'' as a function of T for the 3D 
EA model with different L values. 



The previous work of other authors on chaos was point- 
ing toward the presence of temperature chaos. On one 
side in this context the analytic computations have by no 
means an unambiguous meaning, since they are based on 
strong assumptions or on a perturbative and/or approx- 
imate treatment. On the other side numerical compu- 
tations of older generations were much limited in scope 
as compared to what we can do now. For example Ri- 
tort numerical computation [M , that was correctly, in the 
limit of the gathered data, finding chaos, was looking at 
a T starting value of 0.4, and a dT of 0.5 (as compared to 
the 0.0125 we have been able to use here), i.e. was com- 
paring T = 0.4 to T = 0.9 (where Tc = 1) on reasonably 
small lattice. In this case the decrease of the overlap is 
clear, but turns out to be due to finite size effect (since 
even the equal T overlap has to go to zero at Tc). 

A last comment (following for example ||l^) is about 
the relevance of the absence of chaos for the description 
of realistic, finite dimensional spin glasses. In short the 
absence of a temperature chaotic behavior makes impos- 
sible a modified droplet like description of realistic spin 
glasses (the original droplet model cannot work for ex- 
ample because of the observed dynamical scaling of the 
energy barriers). 

Following ||l^ one notices that the very weak depen- 
dence of spin glass physical properties on the cooling rate 
is not plausible in a scenario of activated domain growth. 
Only arguing that there is temperature chaos one can rec- 
onciliate the negligible effect of the cooling rate with a 



droplet picture. The absence of temperature chaos makes 
this reconciliation impossible. 

We are aware that G. Parisi and T. Rizzo in a perturba- 
tive computation close to Tc find absence of temperature 
chaos (at the order they do compute, but not necessar- 
ily at all orders in perturbation theory), both in the SK 
and in the DMF model. S. Franz and I. Kondor have 
connected evidence that excludes temperature chaos at 
lowest orders close to Tc- We deeply thank all of them, 
together with J. -P. Bouchaud and F. Ritort, for interest- 
ing conversations. The numerical simulations have used, 
together with a number of workstations, computer time 
from the Grenoble T3E Cray and the Cagliari Linux clus- 
ter Kalix2 (funded from Itahan MURST under a COFIN 
grant). 
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